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16.0 INTRODUCTION 


In this unit we look at a new type of space with a structure richer than 
vector space structure. The new space is called a Euclidean space, and the 
way it differs from a vector space can be stated in geometrical terms. 


In a vector space we do not define the length of a vector, nor do we define 
the angle between two vectors. (If one vector is a scalar multiple of another, 
then we can say that their lengths are in the ratio of this scalar, and that 
the angle between them is 0? (or 180°) but this is a very special case: if the 
vectors are linearly independent such comparisons make no sense.) 
Loosely, we could say that the language of vector spaces does not contain 
any words for “length” or “angle”. What we want to do now is to add 
these words to our mathematical vocabulary; that is, we shall define a new 
mathematical structure which contains concepts that cannot be described 
in the “vector space language". You will remember that we describe a 
Vector space as a set of objects (vectors) together with two operations: 
addition of vectors and multiplication of a vector by a scalar. To convert 
the vector space to a Euclidean space we attach one more operation to the 
list. The new operation is a new type of multiplication: the inner product. 
It is a binary operation on vectors that is not closed: the inner product of 
two vectors is a scalar, not a vector. 


You have already met in Unit M100 22, Linear Algebra I, the inner product 
for geometric vectors: 


ху xl |у| cos 0 


Where x and y are geometric vectors, | х| and | | their lengths, and 0 the 
angle between them. 


*y 


Notice that x - y is a scalar, not a vector. If we use this operation as well 
as the two vector Space operations, we are using geometric vectors as a 
Euclidean space. For example, we can use it to tell us when two vectors 
are at right-angles; for if they аге we have 0 = л/2 and so cos 0 = 0, and 
hence x - y = 0. Thus the inner product allows us to make statements about 
angles in algebraic terms which we could not do using vector addition and 
scalar multiplication alone. 
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161 INNER PRODUCTS 
16.1.1 Definition 


To define an inner product by generalizing the formula x · y = |x| |y |cos 0 
would be to beg the question—we do not yet know how to define the angle 
0 or the length |x|. The method we adopt is in fact the exact opposite. We 
define x - y first, then define length and angle in terms of it. The definition 
of x- y is formulated in the first reading passage. 


READ from page K256 to the line above Example | on page K25 


Note 

Last paragraph of reading passage Тһе Equations (7-2), (7-3) and (7-5) tell us 
that the inner product is a bilinear form as defined in Unit 14, Bilinear and 
Quadratic Forms. This is also exactly the condition of Equation (7-6). From 
Equation (7-1) we know that this bilinear form has to be symmetric and 
Equation (7-4) tells us that the associated quadratic form is positive definite. 
Hence we could have defined an inner product function as a real symmetric 
positive definite bilinear form. 


To determine whether a suggested inner product is indeed an inner product, 
we must check that 


X y is defined on each pair of vectors; 
x: yis real; 


each of properties (7-1), (7-2), (7-3) and (7-4) holds. 


Example 


‘The inner product for geometric vectors іп R? satisfies each of the above 
points*. (You can verify this by referring to sub-section 22.1.6 of Unit 
M100 22, Linear Algebra I.) 


Exercises 


l. Exercise 11, page K260. 


2. Exercise 7, page K259. (Read: the “ whenever” in Equation (7-7) as 
“if”) 
3. If xi, х2, хз are such that x;-x,;=0 for i # j, and 


3 
х= ох; + 02 X, + 3X3 =) оху, 
іші 


3 
y = Bx, + Вх + Взхз = > fixi 
Ei 


find y; such that 
3 
xy = гю. 
i 


Solutions 


І. (a) Since x - y is an inner product, x ° y is real and defined for 
all x, y. 


We verify conditions (7-1) to (7-4). 
(11) хоу-2(х-у-20-д-уех 
(7-2) (ох) оу = 2(ax) ' y) = 20(х · y) = a(x ° y) 


* We shall use R? and X? to label the spaces of geometric vectors. See Section 1-8 of K for 
a discussion of the isomorphism of the two-dimensional case. 


(7-3) (x, + x>) ° y = 2((x, x3): y) 
= 2, y + x> ` y) 
—205 y) + 2(x; ` y) 
=xi°y+x;°y 


(7-4) x ox = 2(х:х) 2 0 as x ` x > 0. 
0 = x ° x = 2(x · x) if and only if x : x = 0, 


i.e. if and only if x = 0. 


(b) For any « we are able to verify conditions (7-1), (7-2), 
(7-3). However, for condition (7-4) to hold it is neces- 
sary and sufficient that о > 0. 


2. We start by proving 0 - y = 0 for all y. Following the hint 
we consider (0 + 0) - y. Expanding, we obtain 


(0+0)-y=O0-y+0-y 
Also (0+0)-y=0-y,as0+0=0. 
Hence O-y=0-y+0-y. 
Subtracting 0 · y from both sides we have 0 = 0 - y as required. 


Since the inner product is symmetric we prove x-0=0-x=0 
by the above with x for y. Note, however, that the converse is not 
true: if x - y = 0 it does not follow that either x or y is zero. For 
example, with geometric vectors, we can have cos 0 — 0, i.e. x 
and y are at right angles. 


3. By bilinearity we have that 


The only non-zero terms occur when i = j. Hence 


3 
x:ycYufxx 
= auf, xi X 02 Вх ` X2 + as s X3 ` X3. 


ie.y;—0;f;, i= 1,2, 3. 
16.1.2 Examples 


We now look at some very common inner products. 


READ from Example 1 on page K257 to the end of Section 7-1. 


Note 
line 11, page K258 Note these conventions. 


Examples 
1. Exercise 1(b), page K259. 
x= (4,4, Diy =(-4, 4, 2). 
We use the definition of x - y in 2", given in Equation (7-8) on page K257, 


ix(-Doix4clx2 
= -1+2+2 = 34. 


ху 
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2. Exercise 2(b), page K259. 
From Equation (7-9) 


1 
e= а-ә 
0 


- [е — x?) dx 
0 


-i-i-d 
3. Find f- р for the following vectors in С[0, 1] when the inner product 
is defined with respect to the weight function r(x) = е". 


f(x) = xe^*?; р(х) = (1 + x)e ^7. 


By Equation (7-10), we have 


£ 
f:g -Í хе”*!® (| + x)e7*/?6* dx 
0 
£ 
-Í (x + x?) dx = š. 
0 


Exercises 


Exercise 1(a), page K259. 

Exercise 2(a), page K259. 

Exercise 3(a), page K259. 

Exercise 4, page K259. 

Given any 2 x 2 matrix А we can define a bilinear form on the space 
of 2 x 1 matrices as follows 


(X, Y) — X: Y-X"AY. 


Pn „Жый Жы 


For which of the following matrices is this an inner product? 
(a) [21] (5 [-10] o fil I]. 
11 10 I 1 
(Hint: an inner product is a real symmetric positive definite bilinear 


form.) 


6. Exercise 10, page K260. 


Solutions 


1. x'y =(4, 2, —1) : (4, —2, 3) 
-іх4-2х2-1х3-2-4-3--5. 


1 
2; r: = [ x(1 — х?) dx 


0 


> 1 
-Í T x? dx 
0 0 


-i-i-k 


1 
te= fea- 294m ри L =0. 
0 


e 


4. x'yis real and defined for all x, y. 
We verify the conditions (7-1) to (7-4). 
(11) xy = xy + + х,у =i H yx, 
-у-х 
(7-2) (ох) "у= оху +@х›у; ++ xs y, 
= «(ху ++ x, Yn) = a(x: y) 


(7-3) +X) y = (ху + xD + + („+ ду, 
= охуу ++ Xa Yn + XQ 
+'' Xa Ya 
=x: y +x: y 
(1-4) Since x ` x = Ў хьх-х>0, and x - x = 0 if and 
only if x, 0 for all i, that is x = 0. 


5. In each case we have a real bilinear form so we only need to 
Check that it is symmetric and positive definite. 


(a) Since [ il is symmetric, the bilinear form is symmetric. 
Also, if ¥ = М ; 

Ха 
X X = 2x} + 2хух oxi 


= x + (x; + x>)° 


ie X- X >20 and X- X = 0if and only i x = [o]. 


Thus the bilinear form is positive definite and hence defines 
an inner product. 
‘ -1 0). sy 
(b) Since 10115 not symmetric, it does not define ап 


inner product. 


© Ifx= Li] and Y= E 
XTAY=0, 
and hence the matrix does not define an inner product. 
6. (а) p:q is defined for each pair of vectors and p -q is real. 


(7-1) follows since multiplication on the reals is commu- 
tative. 


(7-2) follows since multiplication on the reals is distribu- 
tive over addition. 


(7-3) follows since multiplication on the reals is distribu- 
tive over addition. 


(7-4) Since p: p = У a; p: p > O and p: p= 0 if and only 
і=0 
if p(x) = 0 + 0x +--+: + Ox", іе. р = 0. 
(b) 2 as a vector space is a subspace of С[а, b] as a vector 
space. We therefore compare the definitions of the inner 
product given for 2 and C[a, b]. The inner products do 


not look the same; we therefore investigate the definitions 
for two simple vectors. 


Ifp(x)- x and (х) = x, 
in @,p ` q = 0; 


b ы-а- 
in Cla bh pa [n i #0 if b# —a. 
Hence 2 is not a subspace of C[a, b]. Other examples show 
that @ is not a subspace of C [a, b] for any a, b. 


16.1.3 Summary of Section 16.1 


In this section we defined the terms 


inner product (page K256) 
Euclidean space (page K256) 
Euclidean n-space (page K257) 
weight function (page K258) 


The most important inner products for our purposes are: 


x:y e xy, in R" (pege K257) 
іші 


f-g= fi roxor dx in C[a, b] (page K258) 


a 


where r(x) is non-negative with only a finite number of zeros in (а, b]. 


Technique 


Given two vectors in А" or two functions in C[a, b], find their inner product. 
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16.2 LENGTH, ANGLE, DISTANCE 
16.2.1 Definition of Length 
READ Section 7-2 starting on page K261, to line 4 on page K262. 


Examples 
l. Exercise 1(b), page K265. 
By Formula (7-13), the length of x is 
Ixl = VOY + C737 +G/2 + Q* 
= ,/ 6.25 = 2.5. 
2. Exercise 3(a), page K265. 


By Formula (7-14), the length of f is 


1 1/2 
{|| = (| хх хах) 
0 
x37 1\ 1/2 1\!? 
-(5]) -@- 
1. Exercise (с), page K265. 


2. Exercise 3(b), page K265. 
3. Exercise 15, page K267. 


Exercises 


Solutions 
1. 16,4, —3,1)[ = /G,4, 3.0: (3, 4, —3, 1) 
= 4/9 +16+9+1 
= 35. 
1 1/2 1 1/2 
жә = x/2y2 
2 = (|, Ugo dx) = (|, (e^ dx) 
1 1/2 
= (| e* ax) = (е — 1), 
0 
3. Jaxl] = Vax- ox = Ja? /x-x = |a] [Ix]. 
16.2.2 Angie and the Schwarz Inequality 


How do we define angle in terms of inner products and lengths? In the 
Foundation Course we defined the inner product on geometric vectors by 


x:ydxl |z | cos 0 


and hence 
xy 
cos 0 = — 
[z] lvl 
The expression Eyl is meaningful for any Euclidean space, and as we 
x| |у 


shall see in the next reading passage, enables us to define the angle between 
two vectors x and y. 


READ from line 5 on page K262 to the end of page K263. 


Notes 


(i) line 7, page K262 The law of cosines states that if a, b and c are the lengths 
of the sides of a triangle and 0 is the angle opposite the side of length a, then 


а? =b? + с? — 2bc cos 0 


(ii) lines —8 and —1, page K262 The following figures illustrate these two 
lines. In the left -hand figure о and В are chosen to make OP = OQ. 


ax 


[*) 


VX-x y 


(iii) line —2, page K263 Therefore, the angle may be obtuse but not negative. 


Example 
Exercise 4(b), page K266. 


Ixl =V} +I +4, lly] =./4 + 16 + 64, 
x-y=1+4+16=21. 


ху 21 
Hence cos 0 = ——— = ———— = ] 
ІІ ly = /22 /84 
ie. 0 = 0. 


(Did you notice that y = 4x and hence the vectors are linearly dependent?) 


Exercises 


1. Exercise 4(a), page K266. 
2. Exercise 4(e), page K266. 
3. Exercise 9, page K266. 


Solutions 


1. The angle between x = (1, 1, 1) and y = G, — 1, +) is 0 where 
X Y 4 
ixl iyi 


Hence 0 = л/2: the two vectors are at right angles. 


2. The angle between x = (—3, —1, 0) and y = (1,2, -,/9 is 0 
where 


xy 
g2-——— 
ixi Iyi 


-5 


2n 
H 0---. 
епсе 3 


12 


Ву 


UH 
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3. Comparing the desired result 
1 1 А 
(++) +6) >п 
а, Qn, 


with Cauchy’s inequality, Equation (7-18), suggests we look 
for vectors x and y in 2” such that 


EA 1 1 
Sowetyx = (Jap =: fa) andy (T= X) 


e 
а, 


and since these give 
х-у= xci +6 +1=n, 
the Cauchy inequality gives the result we want. 
16.2.3 Distance 
READ from page K264 to the end of Section 7-2 on page K265. 


Notes 


(i) line —1, page K264 The following figures illustrate Equation (7-27). 


х+у Ix+yll 


(ii) line 10, page K265 Equation (7-28) is illustrated by the following figure. 
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Example 
Exercise 2(b), page K265. 
We first calculate x — y: 
(7, —4, 1, 3) — (2,1, 48) = (5, —5, 5, —5). 
The distance between x and y is therefore: 


Ix — yl = 4/25 + 25 + 25 + 25 = 10. 


Exercise 


Exercise 2(a), page K265. 


Solution 
x —y —(1, —2, 0, 2) 
The distance between x and y is 


Ix -yl - 1-406423. 


16.2.4 Discussion 


We have seen how an inner product on a vector space can be used to define 
a norm and then distance. All these ideas have to some extent separate 
existences. There are spaces which have a norm but no inner product and 
spaces which have a distance but no norm. Whereas an inner product on 
a real vector space V is a mapping 


Их И — К 
with the properties of Definition (7.1), a norm is a mapping 
п: V —— В, where n(x) = |х), 
such that | 
G Ix|=0<=x=0. 
Gi) ах] = [а| Ixll (Gen) 
Gü) Ix + yl < xl + yl 
and a distance is a mapping 
d: V x V — R 
such that 
@ dx,y)=0 + x=y 
Gi) d(x, y) > 0 
Gii) d(x, y) = d(y, x) 
Gv) d(x, y) + d(y, 2) > d(x, 2). 


The distance axioms do not use any vector space properties and it is 
possible to define a distance function on an arbitrary set. 


The relationship between these ideas is that given an inner product, we 


can define a norm |х| = ух ` X, and given a norm, we can define a distance 
d(x, у) = |х — УІІ. These definitions do in fact give a well defined norm 
and distance. Most of the properties needed have been verified in the text. 
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16.2.5 Summary of Section 16.2 


In this section we defined the terms 


length (norm) (page K261) 


angle (page K263) 
distance (page K264) 
Theorems 


l. (7-1, page K262) (Schwarz inequality) 
If x and y are any two vectors in a Euclidean space, then 


(ху)? < (x ` x) (y ` y). 


2. (Lemma 7-1, page K264) (triangle inequality) 
If x and y are arbitrary vectors in a Euclidean space, then 


Ix + уй < lixll + УІ. 
Technique 


Given two vectors in a Euclidean space, find their lengths and the angle 
and distance between them. 


Notation 


lxii (page K261) 
d(x, y) (page K264) 
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163 ORTHOGONALITY 
16.3.1 Definition 


Having defined the angle between two vectors, we can look at the possi- 
bility of two vectors being perpendicular. In the case of geometric vectors, 


i д 
we say that two vectors are perpendicular if the angle between them is y 
i.e. cos 0 = 0. In the same way, two vectors in Euclidean space are perpen- 
dicular or orthogonal if cos 0 = 0, i.e. if and only if x : y = 0. 
Example 


If x = (1,2, —1, 23) and y = (3, -2, 4, D, x: y = 0; i.e., x and y are 
orthogonal 


READ from page K268 to line —10, page K270 


Notes 

(i) Definition 7-5, page K268 Note that the zero vector, 0, is orthogonal to 
every vector but 0 cannot be in an orthogonal set. 

(ii) line 8, page K269 А unit vector is a vector of length 1. 


(iii) Equation (7-37), page K270 These integrals can be evaluated with the aid 
of Section ITI. 5.1 of TI. 


Example 


Find a vector of unit length which is orthogonal to a — (2, 1, 3) and 
b = (1, 1, D. 


Let c — (с, 05, сз) be a vector that is orthogonal to a and to b. Then 
a ° c = 2с; + c> + 304, = 0 

and 
b: c= c, + c; + cx = 0 


Reducing to Hermite normal form gives 


so that c = (—2c3, сз, сз). 


The condition that c be of unit length gives 


Па = уа +03 = 1, 


іе, сз = + Ji 


Thus both (= ld ) ana ( 2 =l =) are vectors of unit length 
SS =e Se — of uni 
ede ds Ғе МЕ 


orthogonal to а and b. 


Exercises 


Exercise 1, page K271. 
Exercise 3, page K272. 
Exercise 4, page K272. 
Exercise 5, page K272. 
Exercise 8, page K272. 
Exercise 11, page K272. 


Osa SRS 
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Solutions 


1. We want to verify that [х + yll? = lxi? + ly]? for x = sin, 
y — cos. 


InP = xox | sin?x dx = п 
ie 
z 
lvl? » y-y -f dip dics 
= 
Ix yl? = y): (x y) 


x 
-| (cos x + sin x)? dx 

-x 

к 
-[ (cos? x + 2 cos x sin x + sin? x) dx 


к z 
-[ a2 cos x sin x dx = 2л. 


(see Section III. 5.1 of TI for Г cos x sin x dx) 


Hence |х + yl]? = [|х[? + Iyl]? is verified. 


2. We write 1, x, х2 — 31 for the functions хк 1 
x—— x, x —— x? — 1; then we have 


1 x^]! 
1-х- ах = |— =0 
x [хе б. 
1 i 1 x x] 
Cede ET. 
(x 3 iy e= акыш 
1 


and hence the functions are mutually orthogonal. 


3. The length of Ix ji? 


кі SE ixl т. ` 


4. To make the set of vectors of K's Exercise 3 orthonormal, we 
only need to make each vector normal (i.e. of length 1) as they 
are already orthogonal. We have seen that, if x is non-zero, 
x/||x|| is of unit length. Hence 


1 x a 
HAN? ei? x? — Hi 


is an orthonormal set, where 


1 1/2 
ІШ = ./1: -([ 1 dx) =2'# 


Ix = yx x = (ғ a)” _ Q^ 


Ix? — 31] = V? — 30 G7 — H) 
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Thus the orthonormal set is 


5 1 
Е L [2x3 5 (2-31). 
J2 V2 8 3 
5. If the vector z = (a, b, c) is of unit length and orthogonal to x 
and y we have 
z:z—l,z:x-0,z:y-0; 


ie @ +h xccl, 


a—b-0, 
2а+Ь—с=0. 
Reducing the last two equations to Hermite normal form gives 
а-іс-0 
5-іс-0 


so that 2 must be of the form (3c, 4c, c). Substituting this in 
the first equation gives 


142 1,2 M oes 
$c $c + e° = 1, 


ie. c = +—= 


Jit 


1 
Thus we have the two solutions z = + Уй (1, 1, 3). 
1 
6. Letthe required combination be 
f: x — ae + фе * (x e [0, 1] 
where a, b are real constants. 


For f and exp to be orthogonal in C[0, 1], we require 


1 
O=f- exp = | e*(ae* + be?) dx 
9 


ae?* 1 


: 2 
= е + b)dx= | 2 


+ bs| 


0 
= 
=5 (2-1) +b 
а 
so that = — 56е _ 1). 
Hence the required combination is of the form 
x— ae* HG —De^* 


Note that the combination with a = 0 is acceptable. 


16.3.2 Linear Independence of Orthogonal Sets 
READ from line —9 on page К270 to the end of Section 7-3 оп page K271. 
Note 
line 1, page K271 Note that Š may be an infinite set. 
Exercise 
Show that 
(к = (1, 2,2, x; = (—2, 1, 2), x, = (2, 2, D} 


forms a basis for R2. 


Solution 


By Corollary 7-1 (page K271) we can prove a set is a basis for V 
by showing that it is an orthogonal set and that the number of 
vectors in the set equals the dimension of V. Here Rš is 3-dimen- 
sional and we have 3 vectors in the set. To show orthogonality: 

Xj!X;,—2 —2—2 444-0. 

x; X, = —4+2+2=0. 

X3°X,=2-44+2=0. 


Thus (хі, х, хз) is a basis. 
We see that it is sometimes possible to simplify the process of determining 
that a set is linearly independent by introducing an inner product. Note, 
however, that not all linearly independent sets are orthogonal. 


16.3.3 Summary of Section 16.3 


In this section we defined the terms 


orthogonal (page K268) жж. 

orthogonal set (page K268) жж» 

orthonormal set (page K268) жжж 

trigonometric polynomial (page K269) жж 

normalized (page K269) жж 
Theorems 


1. (7-2, page K268) (Pythagoras) 
Two vectors x and y in a Euclidean space are orthogonal if and only if жож ож 


Ix + yl? = Ixi? + Iyl. 
2. (7-3, page K270) 


Every orthogonal set of vectors in a Euclidean space 47 is linearly t+ 
independent. 

Technique 

Given two vectors in a Euclidean space, find out whether or not they are жох ож 
orthogonal. 
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16.4 ORTHOGONALIZATION 
16.41 Gram-Schmidt Process 
READ from page K273 to line 4 of page K277. 4 


Note 


line 7, page K273. The notation 8(0) means the same as «>. 


Exercises 
1. Exercise Қа), page K279. 
2. Exercise 3(a), page K279. 
Solutions 


1. To orthogonalize {(1, 1, 0), (—1, 1,0), (—1, 1, D}, we take 
€, = (1, 1, 0), and then 


е = (—1, 1, 0) — a(1, 1, 0) 
such that e; ' e, = 0. Thus 
0=(-1, 1,0): (1, 1,0) —2(1,1,0)- (1, 1,0) 
020 - 20, 
i.e. w = 0, and e; = (— 1, 1, 0). 
For es we want 
ез =(—1, 1, 1) - f(—1, 1,0) — y(1, 1, 0) 
such that e: e; = 0 =е; e, 
The condition 
0 = e3 ' e; -0-02-2у 
implies y = 0 
and 


0 = e3 ` e, = 2 — 28 — 0у 


implies f = 1. 
Hence ез = (—1, 1, 1) - (—1, 1, 0) — 0(1, 1,0) 
— (0, 0, 1). 


The orthogonal basis is 
{(1, 1, 0), (—1, 1, 0), (0, 0, 1). 
2. We wish to orthogonalize the following set in 2* 
{(1, 0, 0, 1), (—1, 0, 2, 1), (0, 1, 2, 0), (0, 0, =1, 1} 
Take e, = (1, 0, 0, 1); 
then e; = (—1, 0, 2, 1) — a(1, 0, 0, 1) 
such that e; - e, — 0. 
This implies « = 0, i.e. (—1, 0, 2, 1) is already orthogonal to еі. 
Hence e; = ( —1, 0, 2, 1). 
For еҙ, we have 


ез = (0, 1, 2, 0) — ((—1,0,2, 1) ~ (1, 0,0, 1) 
such that еҙ ° e, = ее, = 0. 
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The condition ej-e; = 0 implies у=0 (as e, is already 
orthogonal to the other two vectors). 


The condition e, - e, — 0 gives 
0=4- 6f, 
ie. В= 3. 
To avoid fractions we compute 3e; . 
Зе, = 3(0, 1, 2, 0) — 2(—1, 0, 2, 1) 
= (2, 3, 2, —2). 
ie. ез = 10, 3, 2, —2). 
For e4, we have 
e, = (0, 0, —1, 1) — 0, 3,2, —2) 
—e(—1, 0, 2, 1) — (1, 0, 0, 1) 
such that e, : es = e4 ` e> =e,-e, = 0. 
These conditions give 
0=-4-216, ie. ô = -fr 
0 = —1 — 6e, Le. £= —4, 
021-26 ie.(-4. 
To avoid fractions we compute 42e, . 
42e, = 42(0, 0, —1, 1) + 82, 3, 2, —2) + 7(—1, 0, 2, 1) 
—21(1, 0, 0, 1) 
= 12(-1, 2, —1, 1) 
ie. e,=2(—1,2, —1, 1). 
Hence the orthogonalization process gives 
(0,0,0, 1), (—1, 0, 2, 1), $(2, 3, 2, -2, 2(-1, 2, 21, 1)} 


16.4.2 Orthogonal Polynomials 
READ from line 5, page K277 to line 6, page K278. 


Note 


line 12, page K277 It is common practice in Leibniz notation to omit the 
integrand f(x) when f(x) = 1. 


Exercise 
Continue Example 3 of the reading passage to find the polynomials e, 
and e;. 
Solution 
Continuing the process, we require 
e, = X? — 03е; — a, e; — oe, 
such that 
€4 ` es = е ° e> = @q ` e, = 0. 
These equations give 
х3-е)-оҙеҙ-е; 
x! e, = e e> "е, (1) 


x +e, =a, её "е; 
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We know that (see page K277) 


е-е, —2, ее = 4, e3 ` €63 = а. 


1 
Also x? · es -| x (x? — 1) dx = 0, 
or 


м 
ы 
& 
Ш 
E 
x 
ы 
5 
II 
ғ 


For е; we require 
4 
е; = x" — Bye, — Вуез — f; e; — Bie, 
such that 
е5 е = е; 'ез = ës ° e; = €; ' e, = 0, 


This gives 


4 

x" > e3 = fes еҙ 
4 

x“: ez = Bre, ` €z 
4 Ра 

x" ey = Bye; се, 


Also 


ж 

i 

eo 

£ 

lI 
T - 
TW 

^" 
— 

E 

m 

І 
alw 
ako 

a 

x 

1 

о 


ж 
A 

© 
5 

[ 

— 

— 
х, 
іы 
x 

1 
© 


Hence fj, = B, = 0. 


The remaining inner products we require are 
4 P 1 
хќ.ез = (2 dx 
bi 3, 


апа 


x 
x*:e, | х* ах =+. 


Exercise 


Exercise 17, page K280. 
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Q) 


Solution 


0! 
(а) P.(x) = Pop = | 
2! 
Р) = ту х= x 


4! 
PQ) = хоту (ғ - =<) = 2-р 


6! 3х2 
Ру(х) = =; i x x) = ке ix) 


буг 8! (= oS) 
т 2х7 2x4x7x5 
= AiG — $x eg 


(b) The answers are given on page K747. We illustrate the method 
for part (i) only. 


Po, ..., P4 are mutually orthogonal since they are constant 
multiples of the orthogonal sequence which was the subject 
of the previous exercise. 


3x? — 2x + 1 = ag Po(x) + a P(x) + а Р(х), 


since Рз(х), Р(х), ... involve higher powers of x than x?. 
Then, if we take the inner product of both sides with P,(x); 
we have 


r (3x? — 2x + 1)Po(x) dx = ao | (Po(x))? dx 
-1 -1 


since Po, Р, and P, are mutually orthogonal. 
Hence ao = 2. 


Similarly, by taking inner products with P,(x) and Р,(х), a, 
and a; can be found. 


16.4.3 Orthonormal Basis 


READ page K278 from line 7 to the end of Section 7-4. 


Note 


lines —2 and — 1, page K278 We met Exercise 10 in sub-section 16.1.2. 


Example 
We have shown (see the exercise in sub-section 16.3.2) that 
(xi = (1, —2, 2), x; = (—2, 1,2), ху = (2, 2, D} 
is an orthogonal basis for R?. But notice that ||х,| = |х, = 1х3 =3 
An orthonormal basis іп R? would be {4x,, 1x; , 3x4). Call it 
(е, = 3x, e; = }х›, es = 1x5). 
Suppose we have two vectors 
a = e, — te, + 363 
b = fe, + Зе, — ез. 
We сап now use Equation (7-47) to give a : b. 


а-Ә-і-3-і--2. 
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Exercises 


1. Exercise 9, page K279. 

2. Exercise 10, page K280. 
3. Exercise 11, page K280. 
4. Exercise 14, page K280. 


Solutions 
І. (a) If e,., =0 then 
Xp = 94€, + + yey 


This givesx,, &8(e;,..., e,) and hencex,., eS(x,, ..., x,). 
But (x,,..., Xps х,+1) is linearly independent and hence 
X41 € (xy, .... Xp). This contradiction proves that the 
assertion e,,, = 0 is false and hence e,,, я 0. 


(b) S(e,,..., 6) = S(x,,..., x) € S(x,,..., Xx) 
ande,,; = Xp+1 — ое, — ++ —a,e, implies 


ensi € $(е,..., е, X) = 9(Х1,..., X Xa). 


Непсе, 
8(е›,..., Ons 61) © 8(х1,...,Х,, Xi. 
Also 
S(x,, ..., X) = 8(e,..., 6) € (es... 6, 6,41) 
and 
Xati = Chei F 0161 boc + e, 
Ха E $(е,..., 6541) 
Hence, 


S3... Xps Ху) © (6... Cys e +I). 
The two inclusions combined imply 


S(x, ... Xan) = S(e,,..., 0,44). 


2. Since x =} «je; and y =F еу, 
ізі E ізі 
А п 
ху (X««) Ë (5) 
ігі j=1 


5 X 


Now, because (e,,..., e, is given as an orthonormal basis 
eí e; = 0j, Where ó;; = 1 if i =] and 0 otherwise. 


aja 


«В (e; ° ej), by bilinearity. 
ізі 


j 


Hence 


and the only non-zero terms will occur when i = j. 


Hence 
n 
ху- уай. 


3. (а) x'e = (0161 + 05е: +--+ а, е) "е 
= (ee) +++ + о (е, ге) 
= e(e * 04), 
Since e, - e, = 0 for j #1. 


Hence, o, = (x : e,)/(e, е). 
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Similarly, о; = (x ` e)/(e;- e), for i = 2, 3, ..., n. 
(b Ifx= Ye and y= Y fen 
ізі іті 
коре Ве е) 
at 


But since the basis is orthogonal e; е, = 0 (i з j), hence 


г @ ` ep (уге . 
E à (е-е) (e, e) fees by part en. 


= boc ex e) e) 


(a) In C[-z, я] 


figs f I(x) g(x) dx. 
To orthogonalize (1, sin, sin?), we take e, = 1 and look 


for 
e; = sin — al 


such that 


e5;:e, = 0. 
л 

е, 'е; = (sin x — о) dx 
-z 


= [—cos x — ax]*, = 0 — 2ол. 


Hence о = 0, and so 
e; = sin. 


For es, we want es = sin? — asin — 0; 
such that еҙ : e; = e: e, = 0. 


x 
0=e6;'6; -Í (sin? x — e, sin x — e>) dx 
== 


iS 


— asin х -«) 4х 


= [G — ;)х]®„ = (4 — а2)2л. 


x 
0-е;:е; -| (sin? x — a, sin? x — a, sin x) dx 


* in? x «(— $2) 
=. sin; 1 2 


— a sin x) dx 


s! 
= --аул. 
2 |-х 


For | sin? x dx, see Section III. 4.2 of TL) 


Hence a, = 0 and es = sin? — 4. 


Hence the orthogonalized set is (1, sin, sin? — 1}. 
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(b) We already know that sin? — 4 is orthogonal to І, sin), 
hence all we need to do is normalize it. The vector we 
want is 


sin? — 4 

Isin? — l| 
Now ||sin2 — 4? = | (sin? x — 4)? dx. 
But (sin? x — 3) = —1 cos 2x. 


л 


The integral becomes | 1 cos? 2x dx 


-r 


1 л 
zi (cos 4x + 1) dx 
8.-. 


- 5l 27 
= = 


ee ae 
Hence, the vector we require is ft (sin? — 4). 
л 


16.4.4 Summary of Section 16.4 


In this section we define the term 
Gram-Schmidt orthogonalization- process (page K277) 
Theorem 


(7-4, page K276) 
Let xi, X2, ... be a (finite or infinite) set of linearly independent vectors 


in a Euclidean space 4) such that for each integer л, S(ej, ..., e) = 
S(X,, ..., Xa). Moreover, the e, can be chosen according to the rules 

е = х; 
апа 

Enti = Xu — Hey — 777 — 0,6, 
where 

Хафа ` €1 Хазі Өз Xnr ` @, 
іт 
ерте ' еҙ“ е; i е-е, 

Technique 


Given a set of linearly independent vectors, use the Gram-Schmidt ortho- 
Bonalization process to construct an orthogonal set spanning the same 
subspace. E 
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16.5 SUMMARY OF THE UNIT 


А Euclidean space is a mathematical structure consisting of a real vector 


Space together with a particular type of bilinear form called an inner 
product. ` 


Starting from this definition developed in the first section we went on to 
define length, angle and distance in a Euclidean space in the second section. 
The third section looked at orthogonal vectors in a Euclidean space and 
the fourth section introduced a technique for orthogonalizing any linearly 
independent set of vectors—the Gram-Schmidt process. 


Definitions 
inner product (page K256) 
Euclidean space (page K256) 
Euclidean п-врасе (page K257) 
weight function (page K258) 
length (norm) (page K261) 
angle (page K263) 
distance (page K264) 
orthogonal (page K268) 
orthogonal set (page K268) 
orthonormal set (page K268) 
trigonometric polynomial (page K269) 
normalized (page K269) 


Gram-Schmidt orthogonalization process (page K277) 


The most important inner products for our purposes are 


х-у= LA y; in А" (page K257) 


fe s= [ror dx in C[a b] (раве K258) 


where r(x) is non-negative with only a finite number of zeros in C[a, b]. 


Theorems 


1. (7-1, page K262) (Schwarz inequality) 
If x and y are any two vectors in a Euclidean space, then 
(xy)? «Gc x)(y у). 
2. (Lemma 7-1, page K264) (triangle inequality) 
If x and y are arbitrary vectors in a Euclidean space, then 
|x + yll < lix] + Iyl- 
3. (7-2, page K268) (Pythagoras) 
Two vectors x and y in a Euclidean space are orthogonal if and only if 
Ix + y|? = xi? + ПУП. 
4. (7-3, page K270) o | 
Every orthogonal set of vectors in a Euclidean space *U is linearly inde- 
pendent. 
5. (7-4, page K276) | Р | 
Let x,, X;, ... bea (finite or infinite) set of linearly independent vectors in a 
Euclidean space W such that for each integer n, 5(е,,...,е,) = S(x,,.... x). 
Moreover, the e, can be chosen according to the rules 


e = Xi 
and 
емы = X441 — Hl 777 On n> 
where 
X44 56; Жз б _ Хазі б 
ure" а терер 770 Tee, 
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Techniques 


1. Given two vectors in A" ог two functions in C[a, b], find their inner 
product. 


2. Given two vectors in a Euclidean space, find their lengths and the angle 
and distance between them. 


3. Given two vectors in a Euclidean space, find out whether or not they 
are orthogonal. 


4. Given a set of linearly independent vectors, use the Gram-Schmidt 
process to construct an orthogonal set spanning the same subspace. 
Notation 


Ix]! (page K261) 
d(x, y) (page K264) 
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16.6 SELF-ASSESSMENT 


Self-assessment Test 


This Self-assessment Test is designed to help you test your understanding 
of the unit. It can also be used, together with the summary of the unit, for 
revision. The answers to these questions will be found on the next non- 


facing page. We suggest that you complete the whole test before looking 
at the answers. 


1. Are the following inner products? 
G) х-у- ху + 2x2 y2 (х,уе А?) 
Gi) x-y = 2хуу, + хуу; + X2yı +4x2 (х,у є К?) 


Gü) f-g- [ „700809 de (ge C10, 1) 


v) te= fœ- Ix~4)f@g@) dx (ge C[0, 1) 


2. x (2, —3, 1) and y = (3,3, 2). Use the standard inner product for 
R? (x+y = хуу + X> y> + xs уз) to find: 


(i) the length (norm) of x, 
(ii) the angle between x and y, 
(ii) the distance between the two vectors x and y. 


3. For f, рє C[0, 1] with the usual inner product (ie. when the weight | 


function r(x) = 1), what are [f] and d(f, g) interms of theinner product? 


4. Which of the following pairs of vectors in R? or C[0, 1] (with their 
usual inner product respectively) are orthogonal? 


@) (0, 1), (1, 0) 

GD (1, D, (1, —1) 

Gii) (1, 2), (1, 1) 

(iv) x —— x, x —— x? 

(Y) x — — ё, x ——— x 4+ 3e7* 

(vi) x — ~, x ——5 14 (1— де 

5. Orthogonalize the following sets of vectors in R? with the standard 
inner product: 

(0 (1,1,0), (1, 21, 1), (1, 2, 1) 

Gi) (1, 0, 0), (1, 1, 0), (1, 1, 1) 

6. Find a vector which is orthogonal to x = (1, 1, 4) and y = (2, —2, 6) 
in Rš. 

7. Orthogonalize the set of vectors (1, x, x}, in the Euclidean space 
formed from C[0, оо) by giving it the following inner product 


m [exe dx 


Normalize the resulting vectors. 
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Solutions to Self-assessment Test 


1. (i) Yes: it is a real symmetric positive-definite bilinear form. 
(ii) No: it is a symmetric bilinear form but it is not positive definite; 
for example (1, —2) - (1, —2) = 0. 
(iii) No: it is not positive-definite. For intance, if 


f: x—— 0 0<x<1 


x— 4 - (x - 3)? «x«l 
+ 
then f is in C[0,1] and #50, but х) ГОР dx = 0 
9 


because f(x) = 0 for 0 < x < 2. 


f(x) 


i 
2 


(iv) No: Again this fails to be positive definite. The weight function 
rx (— + |х - 4D is zero for 0< x <}. 


a(x) 


Hence if f is any continuous function such that f(x) =0 for 
4<x <1 then 


rt | reasons) asco 
° 


Since it is possible to find such functions f which are not always 
zero, condition (7-4), page K256, is not satisfied. 


2. G) ixl = ./@,—3, D ` @, -3 1) = 14. 


x-y -і e Tl 
Wd Jia Jan Зул 


(i) x — y = —(1, 6, 1), d(x, y) = |х — у = 4/38. 


(ii) 0 = cos "1 та 
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3. iti = /Pt= (әу ax)", 


athe) = It ah = E969 = ( ІШ -eo ax) 


4. (i) Yes: (0, 1) (1, 0) = 0. 
(ii) Yes: (1, 1)- (1, 21) = 0. 
Gii) No: (1,2) - (1, 1) =3 0. 


1 
(iv) No: | x dx =} 0. 
0 


(v) No: [ее + 3) ах > 0. 
9 


1 
(vi) Yes | e+1—edx=0. 
0 


5. (i 


(4) 


Take е, = (1, 1, 0), then €; = (1, —1, 1) — a(l, 1, 0) where w is 
chosen such that e, > e, = 0, i.e. 0 = 0 — 2a, a = 0. 


Hence е, = (1, —1, 1). 


Take e; = (1, 2, 1) — (1, 1, 0) — Y(1, — 1, 1) where B, y are chosen 
so that e-e, = e: e; = 0. 


The first condition gives 0 — 3 — 28 — 0, B=. 
The second condition gives 0 = —3y, y=0. 
Hence ез = (1, 2, 1) —3(1, 1, 0) = 4(-1, 1, 2). 
The orthogonalized set is 

{1, 1, 0), (1, -1, 1), 4(-1, 1, 2). 


Takee, = (1, 0, 0), then е, = (1, 1, 0) — a(1, 0, 0) where а is chosen 
so that e; “е, = 0. This gives z = 1 and e, = (0, 1, 0). 


Take e; = (1, 1, 1) — f(1, 0, 0) — (0, 1, 0) where B, are chosen 
so that e: e, = e: e; = 0. This gives 


1-820 1-у-і. 
Hence 3 = 1, у = 1 and es = (0, 0, 1). 
The orthogonalized set is then just the standard basis 


{(1, 0, 0), (0, 1, 0), (0, 0, 1). 


6. Letz — (a, b, c) be a vector orthogonal to both x and y. Then 


x'z=0=a+b+4c 
y'z=0=2a—2b+ 6c 


These equations reduce to (Hermite normal form) 


a+ 33с = 0 
b+4c=0 
Taking c = —2 we obtain a solution z = (7, 1, —2). 
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Take e, = 1, then e; = x — « where a is a constant chosen so that 
ез е, = 0. This condition is 


20 
°= | e "(x — a) dx = | — a. 


Hence « = 1 and e; = (x — 1). 


Then e, = x? — ff — уе, where f, y are constants chosen so that 
езе, = ез е; = 0. These conditions give 


1е.0=2 – 8, апа 


© E 
of e (X — х?) dx — 0 -f e "(x — 1)? dx 
o 


о 
іе. 0 = 4 – у. 
Hence e = x! — 2 — 4е = x! — 4х + 2. 


The polynomials we obtain in this way are the Laguerre polynomials. 
We have used the facts that 


| e" dx-l 
0 
and forn 21 
© 
| e 7x х= п! 
0 


These can be easily proved using integration by parts to obtain the 
recurrence relation 


© © 
| ex" dx= of e *x"7! dx, 
0 
Using 
Ifl? = | e"*[f/ COT. ах 
and 
© 
| e*x"dx=n! 
° 


we obtain 


° 
le P = f e*dxzl 

© 
lezl? = I: е7 – 1)? dx-1 


lel? = | e (2 — Ax + 2)! dx = 4 
о 


Hence the normalized vectors are (1, (x — 1), (x? — 4x + 2). 
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